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ANALYSIS OF A DOCUMENT/REPORTING SYSTEM 

By 

Bernard Narrow 


ABSTRACT 

This document describes an in-depth analysis of the information system 
within the Data Processing Branch, Quantitative measures are used to evalu- 
ate the efficiency and effectiveness of the information system. It is believed 
that this is the first documented study which utilizes quantitative measures for 
full scale system analysis. The quantitative measures and techniques for col- 
lecting and qualifying the basic data, as described herein, are applicable to any 
information system. Therefore this report is considered to be of interest to 
any persons concerned with the management design, analysis or evaluation of 
information systems. 
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ANALYSIS OF A DOCUMENT/REPORTING SYSTEM 


I. BACKGROUND 

The Data Processing Branch (DPB) conducts a large production- oriented 
data processing operation. This operation has grown very substantially over 
the years both in terms of volume of data processed and in operational com- 
plexity. In consonance with this growth there has been an ever-expanding infor- 
mation system, including many types of forms and a multitude of reports. 

No full- scale study had previously been performed of the branch's information 
system. Considering the size of the information system and its rapid growth 
one could reasonably expect that there was considerable potential for stream- 
lining the system and achieving a more efficient and effective system. This 
rationale was the main factor in undertaking this study. A secondary factor was 
the realization that this study would provide the necessary detailed information 
for determining the degree to which the branch's information system should be 
integrated and automated. In other words, this could lay the groundwork for 
developing a centralized branch Management Information System if this were 
deemed advisable. 

In order to evaluate the information system it was necessary to determine 
not only the characteristics to be investigated but also the basis for evaluating 
these characteristics. Quantitative measures of the selected characteristics 
were deemed to be the most useful method of evaluation. However, in search- 
ing the literature, a notable lack of such quantitative measures was found. This 
is rather surprising in view of the multitude of system studies that have been 
performed and the considerable emphasis and attention given to Management 
Information Systems within the past few years. Since the use of quantitative 
measures was felt to be an important factor in the system evaluation, a set of 
such measures was formulated and the methods for arriving at the measures 
were defined. 

It is believed that the measures and methods described herein are of gen- 
eral applicability, i.e., they can be used to evaluate any fair- sized information 
and reporting system. Since, to the author's knowledge, this is the first attempt 
at applying quantitative measures to information systems, the author would 
appreciate comments, suggestions or criticism on this subject. 
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II. METHODOLOGY 


GENERAL 

The main thrust of the study was concerned with documenting and evaluat- 
ing the DPB recordii^ and reporting activities. The initial effort delineated the 
various functions of the production system and collected the facts necessary to 
perform an accurate analysis of the current system. Note that the scope of this 
survey was limited to the information system per se of the DPB and not the op- 
erating procedures or work flow of the branch. Operational aspects of the vari- 
ous functions were considered only if the purpose of the operation was to collect 
or prepare information. 

The user population of concern was defined to be the management and oper- 
ations personnel of DPB, the IPD chief and his assistant, and DPSs (Data Proc- 
essing Specialists) and some DPEs (Data Processing Engineers). Although dis- 
tribution of several reports includes recipients outside this group, these receip- 
ients and their requirements were not considered in the evaluation of the DPB 
system. 


TYPES OF INFORMATION SOURCES 

The number and variations of information sources required some logical 
subdivision in order to simplify individual item and system evaluation. A func- 
tional (from an informational point of view) hierarchy was defined to include: 

1. Basic documents — This pertains to the primary recording documents 
which are the source at which an informational element (datum item) 
occurs. Included here all forms, etc. on which information elements 
are collected or recorded for the first time within the branch. This 
group is further divided into: 

(a) Normal flow — Those that occur in the normal work cycle, and 

(b) Other — Those that occur occasionally or are the result of an un- 
usual event, and whose frequency of occurrence cannot be predefined. 

2. Reporting documents - This includes all reporting media within DPB and 
is also subdivided into: 


(a) Normal flow, and 

(b) Other 


2 



3. Work documents — This category includes all forms, etc. used within 
DPB as a regular part of a function to maintain control or awareness of 
the activity, and includes suspense files. 

4. Data files — Under this category are included aU permanently maintained 
data depositories, usually magnetic tape or card files. 

5. Interoffice memos as a rule are initiated to provide for an unusual cir- 
cumstance or are entirely administrative. As such, they were not in- 
cluded in this study unless they appeared to be of a regular report nature. 
Usually, if a memo were used as a report, the memo format is temporary 
until users have an opportunity to evaluate the proposed format and con- 
tent. At this point, the memo would be changed to a standard report 
document. 

6. Verbal communication plays a part in the information flow within the 
branch, but is not considered in any detail, even in those situations where 
it is the only means of transmitting certain elements of information es- 
sential to the total system. 


TECHNICAL APPROACH 

Historically, one of two methods has been used to evaluate an information 
system. One requires the analysis of the overall operation’s goals and the goals 
of the subdivisions within the operation, and the comparison of the actual situa- 
tion with the theoretically defined optimum. This technique does not lend itself 
very readily to any type of quantitative evaluation. The second method uses the 
current system as a starting point and attempts to evaluate it. Unfortunately the 
literature available on the second method refers to information system analysis 
in "philosophical" terms and is largely of a qualitative rather than a quantitative 
nature. The only methods mentioned in the literature are the graphic tools most 
often used in a study of this nature. Some of the more popular are; 

(a) Information flow superimposed on an organization chart. This can be 
useful as a frame of reference but is awkward in depicting the lateral as 
well as the hierarchical paths of information flow within the organization. 

(b) Multidimensional flow of elements. This is a trace of the routing of in- 
formation from its origin to its destination and includes the factors of 
time, frequency, volume, physical distance, etc. 

(c) Input-output array. This represents the inputs that are used to generate 
each output. This can provide a definition of the minimum number of 
recording points within an operation. 
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Several other types of matrices and representations of operational infor- 
mation systems appear throughout the literature, but these are essentially 
graphic aids requiring significant amounts of further study in order to develop 
any conclusion. 

Therefore, the initial effort of this task was to define several measurement 
criteria and to establish guidelines for collecting and evaluating the raw data. 

The defined quantitative measurements were: 

(i) Redimdancy/overlap — This is a measure of the duplication of informa- 
tion elements contained in the various documents within the system. 

The most detailed collection of data for determining redundancy would 
require the design of a three dimensional matrix, the size of which would 
be defined by the number of information documents (two dimensions) and 
the total number of fields as the third dimension. Each document's con- 
tents would be compared with every other documents' contents and the 
identification of the duplicate fields indicated within the array. Compu- 
tations could determine not only the redimdancy at the document level 
but also redundancy at the element (datum) level. 

However, a calculation of the approximate size of the required array 
indicates that such an array would contain 2 x lo"^ elements (200 x 
200 X 500) — obviously too large to be generated or manipulated manu- 
ally. Hence, such a detailed approach was not attempted. Instead, the 
technique adopted was to compute redundancy at the document level and 
obtain a numeric indication of the redundancy between documents. A two- 
dimensional matrix was prepared with the recording documents and 
reports (used in the normal flow of information) listed as rows and 
columns. Each item was compared with every other item for duplication 
of fields. The number of duplicate fields was entered at the intersection 
of the row and column being considered. Some relatively simple calcu- 
lations provided redundancy rankings and distributions for each docu- 
ment. At a later point in this report, array elements with entries greater 
than a defined threshold value or percent are listed as candidates for a 
more detailed examination. 

The matrix was set up to allow for separate redxmdancey measurements: 

(a) Within the total set of recording documents. 

(b) Between individual recording documents. 
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(c) Within the total set of report documents. 

(d) Between individual reports. 

(e) Within the total system. 

Some basic considerations in the generation of this matrix were: 

• A report generated separately for several satellites but with the 
same report content is not considered redundant with its own set 
of satellite reports. 

• Reports with the same content but different time coverages are not 
considered redimdant. 

• Identification fields are maintained as a separate count in an attempt 
to isolate the redundancy of (Non-ID) information. 

• Differences in the size of the reports (i.e., number of print lines 
per report) are not taken into account in the redimdancy computa- 
tion. 

Redundancy measurements of interest are: total redundancy, redundancy 
of recording, redundancy of reporting, and average redundancy. 

(ii) User Satisfaction — A second basic measure of the information system 
was considered to be a utilization factor — a measure of user satisfac- 
tion. Indices related to the number of users and their level of satisfac- 
tion with an individual report were sought. 

Discussions were conducted with the primary recipients of those docu- 
ments defined to comprise the normal information flow. It was assumed 
that each user could determine his information needs and therefore his 
views were the sole basis of ascertaining the degree to which his needs 
were being satisfied by the reporting system. 

An effort was made during each interview to include, as a minimum, a 
set of specific questions in order to normalize all replies as to the use- 
fulness or satisfaction of each report. 

Questions of interest included (for each document and distribution 
frequency): 
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(i) Individual's satisfaction with frequency of receipt. 

(ii) Classification of the document. 

(iii) Frequency of use as opposed to frequency of receipt. 

(iv) Individual's satisfaction with format/content. 

(v) Approximate percent of document that is used per receipt. 

(vi) Comments. 

The classification of use of a document was an attempt to categorize 
the purpose of the various reports as follows: 

• Monitoring a function 

• Exception Notification 

• Input to a report 

• Reference Tool 

• Work Document 

• General Information 

Frequency of use was defined as the ratio of periodicity of desired or 
actual use of the document versus the periodicity of the receipt. In 
many instances the user replies were stated in qualitative terms, e.g. 
regularly or infrequently, rather than in numeric terms. In these 
cases: 

'Regularly' was equated to a ratio of 1. 

'Infrequently' was equated to a ratio of l/2. 

Separate counts were maintained of the number of responses that indi- 
cated no further need for a particular report. 

The percentage of a report's content that was used was defined as the ratio 
of the number of fields used on a regular basis to the total number of fields 
within the report. 

To arrive at a composite utilization factor, the ratio of the use vs. receipt 
was multiplied by the ratio of use content vs. total report content. Utilization 
values can range between 0 and 100 with the latter indicating that the respondent 
uses and desires the report only as often as he is actually receiving it and that 
the total contents of the report are useful. Overall utilization of a given report 
is obtained by summing the individual respondent utilization values. 
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(iii) Cost — The determination of the various costs for the total system and 
each of its parts is a necessary but complex task. Some of the obvious 
difficulties in determining the cost of a particular report are: 

(a) Input collection or preparation activities can vary from simple ex- 
traction from one report to editing, collating, and keypunching of 
large volumes of data. Input may be generated only once, but used 
to produce several reports, in which case the cost must be dis- 
tributed somehow among the reports. 

(b) Data may be maintained in a different format than its original col- 
lection form in order to be used for future reporting purposes. 

The cost of this data maintenance must also be divided proportion- 
ately among the reports that extract data from it. 

(c) The actual preparation — including publication and distribution — 
efforts must be included for the cost of each report. An attempt 
was made using these three categories to determine an accurate 
cost for each of the reports involved in the normal flow of opera- 
tions within the DPB. Within each of these categories, the re- 
sponsible personnel were requested to indicate the resources used. 
To be provided under each category were the number of manhours 
(by type), the amount of computer time required, and any supplies 
used, if significant. Responses were structured as follows: 

REPORT ID FREQUENCY 

INPUT PREPARATION 

MANHOURS 
COMPUTER TIME 
MATERIALS 
DATA MAINTENANCE 

MANHOURS 
COMPUTER TIME 
MATERULS 

REPORT PREPARATION - DISTRIBUTION 
MANHOURS 
COMPUTER TIME 
MATERIALS 

In order to compare the cost of one report against any other, consideration 
was given to the normalization of the cost data collected. A rule was established 
that: 
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• Frequency had to be adjusted from the period of publication to some 
standard. A reporting cycle was defined as one month and costs were 
adjusted to indicate cost required to produce a report for a one month 
period. By definition, there are 22 dailies per month, 4 weeklies per 
month, 1/3 quarterlies per month. 


III. DATA GATHERING 

Once the specific techniques for the quantitative measurement of the infor- 
mation system had been defined, pertinent facts necessary for the evaluation 
were collected. The collection and orderly arrangement of this data began with 
the several available sources of documentation: 

(a) The three volume set generated earlier by C&S and contains a collec- 
tion of all production and maintenance reports which were in use as of 
that time. 

(b) Standard Operating Procedure manuals prepared by C&S for some of 
the functional activities. 

(c) Informal discussions with several of the key NASA and C&S personnel. 

(d) The NASA Forms Control Management (Code 233) provided access to 
the preprinted forms registered to the DPB. 

(e) Other documentation provided an introduction to the remaining func- 
tional activities. 

In addition to these sources, walk throughs of the individual sections de- 
termined first hand how the source information was recorded. This provided 
a general check on the documented information flow and also served to identify 
many of the work forms maintained and pointed out the different data media. 
During these tours of the facility, copies of available forms and reports were 
collected. 

The first step in the process of organizing this collection of data was the 
division of all information media into two basic categories: 

• Elementary Documents 

• Report Documents 

An additional distinction was made regarding the information fields. Two 
kinds of fields were defined: Basic and Derived. A 'Basic Field' is the datum 
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of original recording; it is the lowest hierarchal order of information that can 
be treated as a discrete entity. A 'Derived Field' is usually a summary or ac- 
cumulation of basic fields, a statistical computation or other mathematical 
manipulation of one or more fields. This distinction is used to indicate the 
minimum number of information elements necessary to establish a centralized 
data base of all information now recorded and reported. 


REDUNDANCY 

Two forms were used to organize the data that was extracted from the 
documents and reports in order to perform the redimdancy computations: 

(1) Redundancy Matrix (80 by 80). 

(2) A table to extract and accumulate the statistics from the matrix. 

(See Appendix I.) 

The following example will illustrate the process used to determine re- 
dvmdancy. Consider four documents with their field identifications listed in 
parenthesis. Note that the same letter appearing with a different document 
indicates the same (redundant) field. 

Document 1 (A, B, C, D, E, F, G, H) 

Document 2 (A, B, E, H, J, K, L, M, R, S, Z) 

Document 3 (B, E, AA, AB, AL, R, V) 

Report 4 (A, F, G, H, I, J, M, R, S) 

A comparison of each of these against the others shows the following 
overlap: 


Comparison 

Redundant Fields 

Total 

(1) vs. (2) 

A, B, E, H 

4 

(1) vs. (3) 

B, E 

2 

(1) vs. (4) 

A, F, G, H 

4 

(2) vs. (3) 

B, E, R 

3 

(2) vs. (4) 

A, H, J, M, R, S = 

6 

(3) vs. (4) 

R 

1 


The total for each comparison would be accumulated and recorded in the table as 
follows: 
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Rj = 4+ 2+ 4=10 = Redundancy for document #1 
R 2 = 4 + 3+ 6 = 13 = Redundancy for document #2 
R 3 = 2 + 3 + 1= 6 = Redundancy for document #3 
R 4 = 4 + 6 + 1 = 11 = Redundancy for document #4 

Interpretation of the data within the table should consider the following 
factors: 

• The variation in the number of fields in the various documents 

• Number of documents which contribute to the redundancy of a given 
document. 

• The contribution of identification ts^ie information in the total redundancy 
figures. 

Also, the following type of distinction should be provided, e.g. a situation 
where 6 documents contain one overlap indication each vs. a 7th document, as 
opposed to the situation in which only 1 of 6 contains six overlap indications vs. 
a 7th document. Note that both cases lead to the same redundancy figure. How- 
ever, the second situation much more readily affords the opportunity to improve 
system efficiency. 


UTILIZATION 

Detailed interviews were conducted with personnel representing all activities 
and management positions within the DPB. Discussions were also held with 
Division Management and Code 565 DPEs and DPSs. The interview structure 
illustrated previously was followed as closely as possible, and shortly after the 
interview, the findings were listed in a table designed for this purpose (see 
Appendix II). 


COST 

All cost information was provided by C&SI personnel in the format requested. 
Some data collection and maintenance costs had to be distributed over several 
reports. A table was also prepared to list the data in a normalized manner 
(see Appendix III). 
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CHARACTERISTICS OF PRESENT SYSTEM 


The dynamic nature of the DPB information system was readily apparent. 
During the course of this study, a number of reports or report subsystems 
were undergoing modification. 

• A series of reports (Equipment Utilization Reporting System) were com- 
pletely redesigned. 

• One report (within the Quality Analysis section) was designed to replace 
five separate reports. 

• A card generation process (T-card) was being altered. 

• A new program to merge two separate data bases (telemetry data quality 
and accoimting files) was prepared (ADICS). 

• Several reports were discontinued. 

• New forms were initiated. 

As expected, the information flow evolves around tiie day-to-day production 
activities. The substance of the reportii^ system centers around production 
status reporting and facility activity (utilization) reporting. Within the DPB in- 
formation system are included the following types of information: 

Historical 

Accounting 

Activity Statistics 

Cost/utilization Statistics 

Quality Statistics 

Project/ Process Status 

Suspense files are the primary work documents of the several functional 
groups. These are maintained for a variety of reasons and in a number of 
different media. The two predominant media are copies of the original form or 
report and manual extraction of desired information into individual work 
documents. 
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Work files are used: 


(1) To provide current status of a project. 

(2) As a reference source. 

(3) To assist in rating the contractor. 

(4) To maintain control of distributed items. 

(5) To record history of activity. 

(6) To accumulate data for eventual publication. 

IV. FINDINGS 

GENERAL 

A coimt of all documents and reports which were in use at the time of this 
study revealed that within the present system, there are 50 basic documents 
exclusive of those pertaining to Systems Maintenance & Reliability. Of the 50 
documents, 31 are part of the normal production cycle and 19 are used occasion- 
ally. During a normal cycle (one month) 67 reports in 90 separate formats are 
published. Other documents including those prepared by the Systems Mainte- 
nance & Reliability group account for another 53 reports. NASA Forms Control 
has on record an additional 26 forms which are not included here; these are 
either obsolete, added since the start of this study, or of doubtful use. All of the 
preceding figures are based on unique document titles; if the number of reports 
is increased to identify the occurrence of a report prepared for each project, 
or the different formats within the report, the number of reports would increase 
by about 75 entries. On this basis, the total count of the number of information 
documents within the DPB would be about 280. 

An accumulation of the tmique fields reported and recorded within these 
documents indicates that there are on the order of 600 separately reported in- 
formational elements. Of this number, 1/3 are estimated to be basic elements, 
the rest are elements whose value can be derived from the set of elementary 
data. 

Some identification (satellite, station, user, date,) information must appear 
in every basic document and report in order to correlate the information content 
to the system function. Within the DPB, identification information extended to a 
maximum of eight unique fields. Any combination of these eight fields can provide 
a valid identification. However, in the DPB information system, usually no more 
than two of these fields are recorded on any document. Examination of those 
documents which register a high system redundancy score shows that generally 
these documents contain a higher number of identification fields than average. 
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REDUNDANCY 


Measurements of redimdancy (overlap) for each document are listed in 
Appendix I. 

A measurement of the total system redimdancy (for this set of documents) 
cannot be computed by accumulating the individual redundancies. This would 
overstate the actual amount, since each individual item's redundancy includes 
comparison with all other items. A computation using this method would double 
the actual system redundancy. 

An accurate indication of the system redundancy is obtained by calculating 
1/2 the total of the individual redundancies. 

The total redundancy of the 31 normal cycle basic documents is 1515. As a 
finer breakdown of this figure, the redundancy within the set of basic documents 
is 714 and the redundancy between the set of basic documents and the set of 
reports is 801. The average redundancy of one basic document in relation to 
other basic recording documents is R = 714 ^ 31 = 23. 

The top six basic documents, ranked in order of highest total redundancy 

are: 


Buffer A/D Log 
T - Card Form 
Leadman's Log 
Post Pass Summary 
Tape Summary List 
Dig Tape Assignment 

Several interpretations of these redundancy values are possible. For these 
basic documents, reference may be made to the Redundancy matrix (not shown 
in this report) to determine if one or a few relationships accounted for a large 
percentage of the redundancy. For instance, the Buffer A/D Log was found to 
be highly redundant with the following basic documents: 

Data Reduction Equipment Utilization Log (DREUL) 

Leadman’s Log 
Line Log 

Post Pass Summary 
Special Req. & Approval 
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Tape Summary Listing 
TDAS Conversion Updates 
T-Card Form 

Additional analysis of the relationships of these forms to each other must 
be performed to determine if more efficient collection procedures are possible, 
or to determine if any other specific recommendations can be made to reduce 
the redundancy. The purpose and use of the forms must be known; ways to 
eliminate some of the forms or replace the group with the new form should be 
considered. For example, the TDAS conversion update form's relationship 
wdth the A/D Buffer Summary is simply one whereby a major part of the Buffer 
Summary is copied in a different format on to the TDAS conversion form. One 
possibility for reducing this redundancy would be to modify the Buffer Summary 
to allow direct key-punching of the TDAS cards from the buffer summary. 

A list of the highest ranking redundancy relationships follows: 

DREUL - Leadman's Log 

- Line Log 

- A/D Buffer Log 

- Questionable Data Report 

Leadman's Log - Line Log 

- A/D Buffer Log 

- Special Req. & Approval 

- Questionable Data Report 

Buffer A/D Summary - Post Pass Summary 

- Special Request & Approval 

- Questionable Data Report 

- Tape Summary List 

- TDAS Update List 

- T-Card Form 

Dig Tape Assignment Form - TAS Assignment 

Dig Tape Assignment Card - TAS Assignment 

Line Test Control Record - Line Test Evaluation Record 

Tape Transaction Request - TSSF Gen. Pur. Form 

TE Log - T Card Form 

Post Pass Summary - T Card Form 

Tape Summary List - T Card Form 
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This group of relationships account for 201 of the 714 redundancies within 
the set of recording documents. On the average, each document was found to 
have 1 identification field redundancy in comparison with each document. For 
the set of 31 normal cycle basic documents, a total of 450 (30 x 30 ^ 2) imique 
comparisons were made between all documents within the set. Based on one 
redimdant id field per document comparison, the total amount of non- id field 
redundancy is about 714 - 450 or 264. Next, by removing the average of one id 
field per comparison from the 21 highest ranking redundancy relationships 
shown above, the estimate of non- identification redundancy is 180. It can then 
be shown that 180/264 or 70% of all redundancy within the DPB’s set of basic 
documents occurs in this highest redundancy subset of basic recording 
documents. 

For the set of 67 reports the total redundancy was found to be 1418. How- 
ever, at the reporting level, redundancy is more difficult to interpret. As a first 
step, the duplication of information between reports should be examined. For 
instance, information may be more meaningful or have greater utilization if 
duplicated in different formats to different personnel or even to the same per- 
sonnel. 

Usually it is not too difficult to justify partial overlap of information within 
reports, but a high percent of duplication may be difficult to justify, especially 
in the situation where the redundant reports are distributed to the same people. 
Cost and utilization of the reports (as shown later on) should be taken into ac- 
count before deciding on actions regarding highly redundant reports. 

A useful approach toward analyzing redimdancy within the set of report 
docunaents is to rank the reports. A ranking of the highest six of the 67 reports 
gives the following: 

Facility Status Report 
Summary of Repro's 
TDAS Chrono 
TDAS Station 
Redigitization Report 
Utilization Reports 

Some of the individual cases which exhibited a high redundancy character- 
istic were: 

Production Analysis Summary — Data Analysis Status Report 
Reprocess Files Report — Edit Release 

Listing of TDAS Cards — TDAS Reports 
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Edit Release 
Facility Status Report 
Prod. Facil. Prob. Report 
Edit Release 
Reprocess Files Report 


— Summary of Repro’s 

— Project Status Report 

— Prod. Analysis Report 

— Prod. Analysis Report 

— Summary of Repro's 


Some redundancy is bound to occur in any large system in order to refer- 
ence the extracted data and the basic source documents. However, if a high 
redtmdancy occurs between a recording document and a report, consideration 
should be given to automation of the process (if it is not already so) to reduce 
manual transcription from source documents to output format. Redundancy 
computation of reports vs. basic documents amounts to 1666. A list of the highest 
redundancy cases involved in the comparisons between the two sets shows the 
following. 


Report 


Line Production Summary 
Repro Reports 
TDAS Reports 
TDAS Reports 
Reprocess Report 
Utilization Reports 


Basic Document 


- DREUL 

- Post Pass Summary 

- Tape Summary List 

- Post Pass Summary 

- TDAS Update Form 

- DREUL 


Each of the intermediate work files prepared within the production process 
is totally redundant. The data is usually copied from another document or sum- 
marized to a personal recording form for future reference. It should be noted 
that these records are maintained because other sources are considered not 
current enough or accurate enough. Eventually all this information is available 
in some other location or form. A separate computation of the redimdancy of 
these intermediate files is not provided here. 


However, mention is made below of the intermediate work files which entail 
a large amount of manual effort. These are: 


Three sets of manual records maintained at TS&S - One set for the activities 
in each of the groups within the operation. 

Dispatch Chrono History of D-Tape Requests 

Dispatch Files (by satellite) of Tape Assignments 

Dispatch Manual Records 
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Analog Tape Request Status 

Current Status Records 

In general, these records are eventually processed into a more useful or 
available form. Most intermediate files serve to maintain awareness of cur- 
rency of telemetry processing, including position of data within production cycle 
and location of related materials. 

Other intermediate work records include: 

• 407 listings of TDAS transactions (held at several positions along the 
production path) 

• Copies of Buffer Log 

• Copies of Post Pass Summary 

• Copies of AITR 

• Copies of Edit Release Form 

Another major source of information is the data files which are maintained 
in the DPB. As with the documents and reports, a determination was made of 
the redundancy present in the data files. Figure 1 indicates the redundancy be- 
tween the data files which are maintained on a regular basis. Excluded from the 
list is the 'Slant Range Data File' which was discontinued, partially as a result 
of questions raised during the study. Of interest in the case of data files is the 
potential for consolidating two or more files. By examining Figure 1 and other 
information (not shown here) collected for this study, a number of candidates 
were foimd for possible consolidation into a common data base. These are the 
TDAS, TAS, TE, UTIL, Q.C., and DTA files. From Figure 1, the following per- 
centages of common fields between each of proceeding files and the TDAS file, 
can be derived: 

% TAS fields in common with TDAS = 39% 

% TE fields in common with TDAS = 47% 

% UTIL fields in common with TDAS = 79% 

% DC fields in common with TDAS = 72% 

% DTA fields in common with TDAS = 60% 
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These numbers refer to the 












numbered field listed under 

^ of Fields 

_F 

Me ID 

ill 

j4 

5^ 


z 

8 _ 

9 _ 

10 

File ID 

180 

1. 

TDAS 

7 0 

1 

0 

9 

11 

18 

6 

1 

53 

18 

2. 

TAS 

0 

0 

0 

5 

1 

4 

10 

1 

17 

12 

3. 

SIC 
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0 

0 

2 

1 

0 

0 

3 

12 

4. 

FAR 



0 

0 

8 

1 

0 

0 

9 

8 

5. 

CALICO 




0 

1 

0 

0 

0 

1 

19 

6. 

TE 





3 

10 

4 

0 

17 

14 

7. 

UTIL 






5 

2 

0 

7 

25 

8. 

Q.C. 







3 

0 

3 

10 

9. 

D.T.A. 








0 

0 

7 

10 . 

EAM 













7 0 

1 

0 

14 

26 

39 

25 

2 

116 

Note: To 

determine the redundancy of 

an 

ndividual file 

, add 

the column and row totals for 

the 

given file. For 

example, 

the redundancy for file ^7 is 

26 + 7 = 33. 


Figure 1. Redundancy Matrix for Data Files 


UTILIZATION 

Discussions concerning document and report utilization were held with 35 
people; generally more than one meeting was held with these individuals. A 
total of 272 responses (a response is one recipient’s reply concerning one of the 
several reports he receives) were made. Of these 61 (23%) indicated they had 
no need to receive a particular report they had been receiving. Notations were 
made to remove these persoimel from the applicable distribution lists. 189 (70%) 
indicated satisfaction with frequency of receipt. Only 159 (57%) indicated satis- 
faction with the format of the separate reports. Other notable findings were: 

(1) Of all instances for which users indicated satisfaction with the frequency 
of receipt, 63% (173 replies) had a content utilization factor of 80% or 
higher. 

(2) A total utilization factor was computed for the system. Using as a base 
the number of instances where the respondents indicated a desire to 
continue receiving a particular document, the average satisfaction with 
the total reporting system was calculated to be 85%. If average utiliza- 
tion of the total system encompassed those instances where the recipient 
indicated no further desire for the report, it would be lowered to 64%. 
The difference between the two percentages represents the improvement 
that can be attained solely by paring the distribution lists. 
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(3) Of the total number of responses DPB management personnel accounted 
for 105 or 38%. In total, they indicated no need in 30 of the 105 instances. 
Utilization of the management group with reports they wish to continue 
receiving was calculated to be 85%. 

A plot of redundancy versus utilization is presented in Figure 2. Note that 
the identification of reports represented by the numbers shown in the plot is 
given in Table 1 . Particular attention should be given to those reports which 
have the combined characteristic of high redundancy and low utilization. One 
such report which possesses this characteristic is the 'Utilization Report and 
Production Status.' Both versions of this report, i.e. the weekly and monthly 
(items #30 and 31) respectively in Figure 2) exhibit this characteristic. Further 
investigation may reveal that the incremental information provided by these 
reports to the recipients can readily be provided by other reports that they are 
not receiving or by slightly expanding the content of one or more other reports. 

Follow-up investigations should also be made of those reports which fall 
into the category of moderate redundancy and low utilization. Referring to 
Figure 2, one such report which fits this categorization is that numbered 36 
titled '% Reprocessed Files Report.' Note was taken of the degree to which 
this report is redundant with the other reports in the system. Based on the 
information contained in the last 3 columns of Appendix 1, it can be determined 
that there are 10 reports that contain almost wholly redundant information (an 
average of 5/6 per report) as the % Reprocessed Report. 


COST 

According to some studies, the amount of effort that is expended in an aver- 
age production-oriented facility in order to record and report information 
(operational and management) may range up to 75 percent of the total non- 
management manpower of a facility. Cost figures relating to the set of key 
documents used in this study are given in Appendix III. As anticipated, the 
largest percent of effort is spent in the maintenance and reporting of historical 
and accoimting information - the Tape Accounting System and Tape Telemetry 
Data Accounting System groups of reports. These two systems require a large 
amount of manual involvement (data preparation, including editing, validating, 
and duplicate record maintenance) and large blocks of computer time for file 
maintenance. 

It is important to consider cost in relation to redimdancy and utilization, 
both singly and in composite. Plots of cost vs. redundancy and cost vs utilization 
are depicted in Figures 3 and 4, respectively. Referring to Figure 3, the main 
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Table 1 

Key to Figures 2, 3, and 4 


1. Daily Line Status Report 

23. Redig. Report 

2. Proj. Status Report 

24. Prod. Fac. Prob. Report 

3. DAO Worksheet 

25. Tape Rec. & Eval. 

4. EAM Daily 

26. Active Stor. & Shipment 

5. EAM Act. Report 

27. Inactive Stor/Shipment 

6 . Dispatch Daily 

28. Edit Release Form 

7. Daily on Line Worksheets 

29. Monthly Sum. of Line Bklg. 

8. D5l Proj. Summary 

30. W. UR & Prod. Stat. W 

9. Prod. Anal. Report 

31. W. UR & Prod. Stat. M 

10. Line Test Evaluation 

32. Activity Report of Tape Staging and Storage 

11. Mag. Tape Summ. 

33. Dispatch Report - Monthly 

12. Sta. Telem. Rep. 

34. Dispatch Report - Quarterly 

13. Data Anal. Stat. Rep. 

35. EAM Downtime 

14. Repro Files Rep. 

36. % Repro Files Rep. 

15. Line Prod. Sum. Rep. (W) 

37. Phase II Util. Chart 

16. Line Prod. Sum. Rep. (M) 

38. Act/hiact Sat. List 

17. Line Prod. Sum. Rep. (Q) 

39. EAM Down time 

18. UTE. Phase II Util. Rep. 

40. EAM Usage/User Code 

19. Condensed Phase II Rep. 

41. Tapes to Ship List 

20. Bad Tape Rep. 

42. Dig. Tape Inventory 

21. TDAS Chrono Report 

43. AS&R Library Inventory 

22. TDAS Station Report 

44. Library Report 


concern are reports which fall into the category of high cost — high redundancy. 
This categorization highlights the potential for substantial cost savings through 
consolidating or eliminating reports. Following this line of attack, report 
numbered 30 in Figure 3 should be of particular interest. This is the Weekly 
Utilization and Production Status report. Further investigation should establish 
whether the information provided by this report can readily be provided by other 
reports, with minor modification. 

In Figure 4, primary interest is in those cases which are categorized as 
high cost — low utilization. This type of plot is useful in segregating reports 
for which a substantial cost savings may be readily achieved by simply elimin- 
ating a report or reducing the frequency or perhaps making the information 
available on special request. One such candidate report is that number 32 in 
Figure 4, which is the Activity Report for Tape Staging and Storage. 
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SEE TABLE 1 FOR 
IDENTIFICATION OF NUMBERED 
REPORTS 
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Figure 2. Utilization vs. Redundancy 






The ideal document from an information system point of view, should have 
a lost cost, low redundancy, and high utilization. Special attention should be 
given to those reports that exhibit the opposite composite characteristics, i.e., 
high cost, high redundancy, and low utilization. By correlating the data plotted 
in Figures 2, 3 and 4 the following sets of reports were foimd to possess the 
combined set of unfavorable characteristics. These therefore would normally 
be the prime candidates for follow-up action. As noted in the next section, 
changes to these reports were in-process during the period of this study. These 
changes are at least partially attributable to the questions and discussions which 
took place in connection with this study. 

TSS Analog Library Reports 
TDAS Reports 
Utilization Reports 
Dispatch Reports 

FURTHER OBSERVATIONS 

Concurrent with the collection of data to provide the above measurements, 
attention was also given to the data handling aspects of the production cycle. 

Some pertinent observations regarding these operations are discussed here. 

• It was readily apparent that the branch information system has been con- 
stantly expanding and subject to frequent change. Most of the information 
is basically of a historical nature; some, of course is used for operations 
and management control and includes substantial manual effort, primarily 
for the maintaining and reporting of work status. 

• For some of those activities which scored high redundancy ratings or low 
utilization/satisfaction ratings — revision is currently underway: The 
Edit Release Form is being modified; a new Tape Evaluation form is 
being designed to avoid the duplicating transcription of data; a new 
Quality Analysis Report and Reporting Procedure is in the design stage. 

It will replace five reports and do away with copying from one form to 
another. A new Equipment Utilization Report ^stem has been designed; 
it will simplify the current procedures and combine the several separate 
reports into one output document. In each of these situations the changes 
will result in significant reduction in the redundancy measured in this 
study. 
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• As one would expect management’s expressed inusrests are trends, status, 
and unusual circumstances. Within the DPB some exception reports have 
tended to fit into the normal report cycle and become regular activity 
reports. Summary reports of a section's activities over a period often 
contain more detail than management is interested in. 

• Bootleg (unregistered) forms do exist within the branch, often as personal 
work tools. These forms are not bad in themselves, although other simi- 
lar forms may serve the same purposes. Unless the form is known to 
exist by the appropriate individual, such determinations cannot be made. 

• At the interface between the functional groups within the production cycle, 
similar statistics are maintained by each of the groups. What one group 
measures in output units another group measures in input units; each 
maintains very similar activity and status (work in process) records. 

Some of these recordings find their way into the daily worksheet of the 
various sections and serve as a type of cross check on the activity of the 
individual sections. 

• DPE's showed an interest in receiving discrepancy statistics (by station) 
in some regular report. They are interested in sequence gaps between 
Digitization Figures and Release Figures. They are interested in any 
problems with the Quality of data and in trends indicating changes in the 
Quality of the Data. 

• There are several situations in which forms are copied to other forms 
for an accumulation or rearrangement for data capture or preparation 
of another report. Other situations involve collection of data that is 
identical to data being collected in other sections. These include: 

Edit Release Form 
Tape Transaction Request 
Line Test Information 
Quality Bookkeeping 
Digital Tape Assignment 
TDAS Updates 

• Some manually prepared reports contain information which is wholly 
available in automated data files and therefore could readily be generated 
automatically. These are: 

Monthly Comprehensive Report 
Facility Status Report 
Summary of Repro's 
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• Buffer A/D Summary is a key document within the Production Facility. 
With minor revision it could do away with several other documents and 
reduce the amoimt of transcription now taking place. 

• Duplicate records of production results are being accumulated and 
permanently saved. For some of these forms and reports more than 
one copy of each is being microfilmed for permanent retention. A re- 
quirement for retrieval of an item from this storage is almost non- 
existent. 

• Quality and Slant Range Card Status Report was determined to be of no 
further need. Additionally, the requirement to maintain the Slant Range 
Card File was determined to be no longer needed. 

• EAM usage by user code is prepared monthly but very little use is made 
of the information contained therein. 

• The Manual Daily Status Activity Report System is an assurance that the 
C&S supervisors are aware of the status of their respective charges; 
this group of reports also contains the nucleus of a major portion of the 
branch's information requirements. 
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APPENDIX I 
REDUNDANCY TABLE 
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Record, overlap Report overlaf 

Item No. of No. of ID Total Redund. at Wstrlbution' Distribution' 

Ident. Fields Fields Redund. Recording T~ Report Level 

Level Total Total 
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APPENDIX II 
UTILIZATION TABLES 
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See page 37. 
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Act/lnact. Sat. List M(5) 

















No. lodicatiiig 

Usefulness > (80%) 

CO rHC^C^CDNiH rH rH rH iHrHCOrHr-<rHiHr-t iH rH tH O OfH 

No. Indicating 
No Need 

O OOOOOO OiHO iHiH OOOiHO OOO N 1-iO 

Total Usefulness 
Total Usefulness^ 

300 

80 

180 

200 

600 

200 

100 

100 

100 

100 

100 

150 

300 

100 

100 

100 

100 

100 

100 

100 

100 

0 

0 

100 

No. Satisf. 
W/Format 

eo OtHi-ISOO© OOt-( .rHiHNOiHrHOf-l OiHr-l O OiH 

No. Satis. 

W/Freq. 

e<5 i-l (N 1 — 1 (M rH iHrHrH rHC'jeOrHrHrHOrH iHiHrH O OrH 

No. of 
Resp. 

n iHNOsItONiH rHCilrH N'^C'SCarHrHMrH iHrHiH M i-H rH 

Freq. 

M(3) 

M(2) 

W 

M 

D 

D 

1 

W 

W 

E(3) 

W(4) 

W 

W(3) 

occ 

W 

W 

D 

W 

M 

M 

M 

Q 

Identif. 

EAM Downtime 
EAM Usage by User 
Code 

DPS Reps, to DPE 
Lib. Reports 
A/D Summ. 

DREUL 

Questionable Data 
Proc. Ops. Control 
Weekly Prod. 

Power Fail. 

Repeat. Tests 
ATS Station 
Error Rep. 

Benson Wkly 
TDAS Update 
Unpro Files Rep 
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